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Specification 
Title of the Invention 
Image Capturing Method and Apparatus and Fingerprint 
Collation Method and Apparatus 

5 

Background of the Invention 

The present invention relates to an image 
capturing method and apparatus for capturing the shape 
of a target object as image data, and a fingerprint 
10 collation method and apparatus which detect a 

fingerprint ridge/valley pattern as image data by using 
the image capturing method and apparatus and perform 
collation. 

In performing fingerprint collation, to 
15 improve collation precision, a fingerprint image must be 
captured to obtain a clear image of a fingerprint 
ridge/valley pattern. Fingerprint sensors used to 
capture fingerprint images in a fingerprint collation 
apparatus of this type include an optical fingerprint 
20 sensor, capacitive fingerprint sensor, and the like. A 
fingerprint sensor is designed to detect a fingerprint 
ridge/valley pattern as optical refractive index 
differences or capacitive value differences and generate 
the pattern as a halftone image. 
25 According to the above fingerprint collation 

apparatus, when a user is to be authenticated by using a 
fingerprint, the fingerprint data of the user is 
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registered in advance. In this state, a fingerprint 
image of the user is acquired by the fingerprint sensor, 
and fingerprint data is generated. The generated 
fingerprint data is then compared with the registered 
5 fingerprint data. If they coincide with each other, the 
user is authenticated. 

The skins of human fingertips vary in state 
among individuals. For example, some persons have dry 
fingers, and others have fatty fingers. In addition, 
10 the state of the skin of a fingertip of a given person 



III changes depending on seasons and physical conditions. 

■ In a conventional fingerprint collation apparatus, 

f|J fingerprint images which change for the above reasons 

||| are detected under the same condition, and hence 

O 

y ; 15 accurate fingerprint images required for collation 

cannot be obtained. If an image in a desired state 
cannot be obtained, accurate fingerprint collation 
cannot be properly performed. 
Summary of the Invention 

20 The present invention has been made to solve 

the above problem, and has as its object to obtain an 
image in a desired state. 

In order to achieve the above object, 
according to the present invention, there is provided an 

25 image capturing apparatus comprising an image capturing 
section for converting a shape of an object into an 
electrical quantity in accordance with a parameter value 
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set in a parameter setting section, and outputting image 
data representing an image corresponding to the shape of 
the object, and a capture control section for receiving 
the image data output from the image capturing section, 
calculating an evaluation index for evaluating image 
quality of the image from the image data, and if the 
evaluation index falls outside a range of a preset 
reference value, changing the parameter value set in the 
parameter setting section so as to make the evaluation 
index fall within the range of the reference value to 
output image data which is received from the image 
capturing section and the evaluation index of which 
falls within the range of the reference value. 
Brief Description of the Drawings 

Fig. 1 is a block diagram showing the 
arrangement of a fingerprint collation apparatus using 
an image capturing apparatus according to the first 
embodiment of the present invention; 

Fig. 2 is a perspective view showing the 
arrangement of part of the image capturing section of 
the fingerprint collation apparatus in Fig. 1; 

Fig. 3 is a view for explaining the state of 
fingerprint image data captured by the image capturing 
section; 

Fig. 4 is a block diagram showing the 
schematic arrangement of the image capturing section; 

Fig. 5 is a view for explaining examples of 



the parameters set in an A/D conversion circuit 14; 

Fig. 6 is a flow chart showing the operation 
of the fingerprint collation apparatus according to the 
first embodiment of the present inventions- 
Figs . 7A to 7D are views showing captured 
image data and histograms representing the grayscales of 
images represented by the image data; 

Figs. 8A and 8B are views showing captured 
image data and a histogram representing the grayscale of 
an image represented by the image data; 

Fig. 9 is a flow chart showing the operation 
of a fingerprint collation apparatus according to the 
second embodiment of the present invention; 

Fig. 10 is a block diagram showing the 
arrangement of part of the fingerprint collation 
apparatus according to the second embodiment of the 
present invention; 

Fig. 11 is a block diagram showing the 
arrangement of part of the fingerprint collation 
apparatus according to the second embodiment of the 
present invention ; 

Fig. 12 is a block diagram showing the 
arrangement of part of the fingerprint collation 
apparatus according to the second embodiment of the 
present invention ; 

Fig. 13 is a block diagram showing the 
arrangement of part of the fingerprint collation 



apparatus according to the second embodiment of the 
present invention ; 

Fig* 14 is a timing chart showing a specific 
example of the operation of the fingerprint collation 
apparatus in Fig. 13; 

Fig. 15 is a view for explaining a ridge count 

index; 

Fig. 16 is a graph for explaining a ridge 
determination condition; and 

Fig. 17 is a flow chart showing the operation 
of a fingerprint collation apparatus according to the 
third embodiment of the present invention. 
Description of the Preferred Embodiments 

Embodiments of the present invention will be 
described below with reference to the accompanying 
drawings . 

<First Embodiment > 

Fig. 1 shows the arrangement of an image 
capturing apparatus according to an embodiment of the 
present invention. This embodiment exemplifies a case 
where the image capturing apparatus is applied to 
fingerprint collation and will be described as a 
fingerprint collation apparatus hereinafter. This 
fingerprint collation apparatus includes an image 
capturing section 1 for converting a fingerprint 
ridge/valley image into image data which is an 
electrical signal and outputting it. The image 



capturing section 1 determines a state of conversion to 
image data in accordance with the parameter set in a 
parameter setting section la. 

The apparatus shown in Fig. 1 also includes a 
storage section 4 storing registered image data Gi to G N 
for fingerprint collation, a finger resting prompt 
section 6 for prompting a user intending to perform 
collation to rest his/her finger on the image capturing 
section 1, a finger resting detection section 7 for 
detecting that the finger is rested on the image 
capturing section 1, and a control section 3 for 
controlling the overall apparatus . 

The control section 3 includes a capture 
control section 3a formed by a CPU for performing 
predetermined computation processing in accordance with 
a program. The capture control section 3a determines 
the image data output from the image capturing section 1 
first, and then changes the parameter in the parameter 
setting section la. The control section 3 also includes 
a collation means 3b for collating image data 2 captured 
by the image capturing section 1 with the registered 
image data G x to G N stored in the storage section 4 and 
outputting the resultant data as a collation result 5. 
These capture control section 3a and collation means 3b 
are implemented by programs. 

Fig. 2 shows the arrangement of the image 
capturing section 1. Many sensor cells 11 are 



vertically and horizontally arranged on a detection 
surface 12 of the image capturing section 1 in the form 
of a matrix. The sensor cells 11 are formed by elements 
for converting a fine ridge/valley pattern of a target 
into an electrical quantity. When a finger 21 touches 
the detection surface 12, the respective sensor cells 11 
detect a ridge/valley pattern of a fingerprint 22. As 
the detection result obtained by all the sensor cells, 
one image data 2 representing a fingerprint image like 
the one shown in Fig. 3 is output from the image 
capturing section 1. ! 

Fig. 4 shows the arrangement of the image 
capturing section 1. Each sensor cell 11 is comprised 
of a detection element 11a and sensor circuit lib. The 
detection element 11a is, for example, a capacitive 
sensor formed by an electrode having an insulating layer 
formed on its surface. The detection element 11a may be 
an optical sensor formed by a photodiode or the like. 

The detection element 11a converts a 
fingerprint ridge/valley pattern into an electrical 
signal. The sensor circuit lib then amplifies the 
converted signal. The output of the sensor circuit lib 
of each sensor cell 11 is connected to a common data 
line 13. The sensor cells 11 are sequentially selected 
to output an analog signal corresponding to a 
fingerprint ridge/valley pattern to the data line 13. 

An A/D conversion circuit 14 sequentially 



converts the analog signals transmitted through the data 
line 13 into, for example, 256 -level grayscale digital 
signals in accordance with the parameter set in the 
parameter setting section la, and outputs the signals. 
5 When the digital signals from all the sensor cells 11 
are arranged in the form of a matrix so as to reflect 
the positions of the respective sensor cells, 

y: fingerprint image data like that shown in Fig. 3 is 

PI obtained. 

12 10 Note that the A/D conversion circuit 14 is 

ft designed to convert an analog signal corresponding to a 

ul 

^ fingerprint ridge/valley pattern into a digital signal. 

J; 4 ; The relationship between the analog value and the 

digital value changes in accordance with the parameter 

5T: v. 

3 : u ,: 

O 15 value set in the parameter setting section la. 

Fig. 5 exemplifies the parameters set in the 
A/D conversion circuit 14 (Fig. 4). Parameters A and B 
are rational numbers equal to or larger than 0. If the 
analog value input to the A/D conversion circuit 14 has 
20 a level less than a set parameter value (A + B), 0-level 
grayscale fingerprint image data is obtained from the 
A/D conversion circuit 14. The 0-level grayscale 
fingerprint image data represents a black image. 

If the analog value input to the A/D 
25 conversion circuit 14 is equal to or larger than a set 
parameter value (A + 255 x B) , 255 -level grayscale 
fingerprint image data is obtained from the A/D 
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conversion circuit 14. The 255-level grayscale 
fingerprint image data represents a white image. If the 
analog value input to the A/D conversion circuit 14 is 
equal to or larger than a parameter value (A + n x B) 
5 and less than a parameter value {A + (n + 1) x B}, 

n- level grayscale image data is obtained from the A/D 
conversion circuit 14. 

As described above, if the parameter value A 
is set to be large, the fingerprint image obtained from 

10 the A/D conversion circuit 14 become black. If the 

parameter value A is set to be small, the fingerprint 
image obtained from the A/D conversion circuit 14 
becomes white. If the parameter value B is set to be 
large, the fingerprint image obtained from the A/D 

15 conversion circuit 14 decreases in resolution. If the 
parameter value B is set to be small, the fingerprint 
image obtained from the A/D conversion circuit 14 
increases in resolution. Note that the number of 
grayscale levels is not limited to 256 and may be 64 or 

20 128. 

Note that the above parameter values A and B 
are used as parameters set in the parameter setting 
section la to be used for conversion in the image 
capturing section 1. However, the present invention is 
25 not limited to them. For example, brightness and 

resolution can be controlled in the same manner even by 
using the minimum and maximum values of a signal 
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conversion range as the parameter values A and B, 
respectively . 

As described above, by changing the parameter 
values in the A/D conversion circuit 14, the brightness 
and resolution of the fingerprint image obtained from 
the A/D conversion circuit 14 can be changed. If, 
therefore, the fingerprint images of human fingertips, 
which change their states depending on individual 
differences, e.g., dry fingers and fatty fingers, 
seasons, and physical conditions, accurate fingerprint 
images free from the influences of individual 
differences and state changes can be acquired by 
capturing images upon setting appropriate parameter 
values . 

The operation of the fingerprint collation 
apparatus (image capturing apparatus) according to this 
embodiment will be described next with reference to the 
flow chart of Fig. 6. 

First of all, the capture control section 3a 
of the control section 3 causes the finger resting 
prompt section 6 to prompt the user intending to perform 
collation to rest his/her finger on the detection 
surface 12 (Fig. 2) of the image capturing section 1 
(step SI). More specifically, for example, the finger 
resting prompt section 6 prompts the user to rest 
his/her finger by displaying a prompt using a display 
unit such as an LED or light-emitting element, turning 



on a predetermined indication, or outputting a voice 
message. After the finger resting detection section 7 
detects that the user rests his/her finger on the 
detection surface 12 upon prompting (step S2), the image 
5 capturing section 1 captures a fingerprint image and 
outputs the image data 2 (step S3), 
U When the image data 2 is output, the capture 

a 

O control section 3a calculates a grayscale index Y, as an 

m 

hk image quality evaluation, which indicates the density of 



ill. 



Ls. 

ir 5 "" 5 



10 the captured image (step S4). Any kind of index can be 
used as a grayscale index as long as it indicates the 
density balance of image data to be evaluated. For 
^7 example, the ratio of the number of pixels with 

grayscale values equal to or less than a predetermined 
15 grayscale value to the total number of pixels of image 
data may be used as an index. Alternatively, an index 
may be calculated by using a predetermined area, e.g., 
an area near the center of the detection surface 12, as 
a target area instead of using the total number of 
20 pixels. In this case, a grayscale index can be 

calculated within a short period of time as compared 
with the case where the total number of pixels are 
targeted. 

In steps S5 to S15, the capture control 
25 section 3a compares the grayscale index Y obtained in 
the above manner with preset threshold Y t ta and Y t h2- 

First of all, in step S5, the capture control 
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section 3a checks whether the calculated grayscale index 

Y is equal to or more than the threshold Y t hi- I f it is 
determined in step S5 that the grayscale index Y is 
equal to or more than the threshold Y thl , the flow 
advances to step S6 to check whether the grayscale index 

Y is equal to or less than the threshold Yth2» If it is 
determined in step S6 that the grayscale index Y is 
equal to or less than the threshold Y t hz, the flow 
advances to step S7, in which the capture control 
section 3a outputs the captured image data to the 
collation means 3b. 

If it is determined in step S5 that the 
grayscale index Y is less than the threshold Ythi# the 
flow advances to step S8 to check whether the parameter 
B set in the parameter setting section la is the maximum 
value * 

If it is determined in step S8 that the set 
parameter B is not the maximum value, the flow advances 
to step S9, in which the capture control section 3a 
increases the parameter B in the parameter setting 
section la by a predetermined value. The flow then 
returns to step S3. If it is determined in step S8 that 
the parameter B set in the parameter setting section la 
is the maximum value, the flow advances to step S10 to 
check whether the parameter A set in the parameter 
setting section la is the maximum value. 

If it is determined in step S10 that the set 
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parameter A is not the maximum value, the flow advances 
to step Sll, in which the capture control section 3a 
increases the parameter A in the parameter setting 
section la by a predetermined value. The flow then 
returns to step S3. If it is determined in step S10 
that the parameter is the maximum value, the flow 
advances to step S7, in which the capture control 
section 3a outputs the captured image data to the 
collation means 3b. 

If Y < Ythi* since the captured image is 
slightly light -colored, a fingerprint image is captured 
again upon increasing the parameter values A and B in 
the above manner. 

If it is determined in step S6 that the 
grayscale index Y exceeds the threshold Y t h2, the flow 
advances to step SI 2 to check whether the parameter 
value A set in the parameter setting section la is the 
minimum value , e.g., 0 . 

If it is determined that the set parameter 
value A is not 0, the flow advances to step S13 to 
decrease the parameter value A in the parameter setting 
section la by a predetermined value. The flow then 
returns to step S3. If it is determined in step S12 
that the parameter value A set in the parameter setting 
section la is 0, the flow advances to step S14 to check 
whether the parameter value B set in the parameter 
setting section la is the minimum value. 



If it is determined in step S14 that the set 
parameter value B is not the minimum value, the flow 
advances to step S15, in which the capture control 
section 3a decreases the parameter value B in the 
parameter setting section la by a predetermined value. 
The flow then returns to step S3. If it is determined 
in step S14 that the parameter value B is the minimum 
value, the flow advances to step S7 , in which the 
capture control section 3a outputs the captured image 
data to the collation means 3b. 

If Y t h2 < Y, since the captured image is 
slightly dark-colored, a fingerprint image is captured 
again upon decreasing the parameter values A and B in 
the above manner. 

The capture control section 3a repeats the 
above series of operations until the image quality of 
image data satisfies a predetermined condition. When 
the condition is satisfied, the capture control section 
3a outputs the image data as an image suitable for 
authentication to the collation means 3b. As described 
above, according to this embodiment, an image in a 
desire state which falls within the ranges of set 
parameters can be obtained. 

Subsequently, the collation means 3b, which 
has received the image data, performs authentication 
processing by comparing the received image data with the 
registered image data G x to G N stored in the storage 



m 



section 4. 

According to the above description, a 
grayscale index is used as an image quality evaluation 
index for captured image data. However, the present 
5 invention is not limited to this. For example, 

saturation, lightness, contrast, or the like may be used 
as an index. 

In addition, a spatial frequency component 
extracted from captured image data by a Fourier 
10 transform may be used as an index. In this case, in 

addition to a grayscale level, whether the response of a 
s fingerprint is properly acquired as an image can be 

III evaluated. Furthermore, an image may be evaluated in 

' m combination with a grayscale index, 

p 15 < Second Embodiment > 

Another embodiment of the present invention 
will be described next. 

In the above embodiment, a grayscale index is 
used as an image quality evaluation index. The ridges 
20 of fingerprint patterns differ in thickness and 

intervals among target persons. For this reason, image 
data determined as data having optimal image quality on 
the basis of a grayscale index may not be image data 
having optimal image quality for authentication. In the 
25 following embodiment, for example, a histogram index is 
used for evaluation of image quality to solve the above 
problem. Note that the ridges are lines forming a 
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pattern obtained from the ridge portions of a fingertip 
skin surface. 

As shown in Figs. 7A to 7D, a histogram index 
from which a histogram representing the grayscale of an 
5 image represented by captured image data is generated 
can be calculated from the captured image data. 
Referring to Fig. 7, the abscissa represents the 
jjjj grayscale value; and the ordinate, the frequency. 

Is;:* 

jJj Grayscale values represent the densities between black 

H 10 and white in 256 levels (grayscale levels). Grayscale 

08 

W level 0 represents black, and grayscale level 225 

■ represents white. A histogram index like that shown in 

fU Fig. 7B is calculated from captured image data like that 

kj shown in Fig. 7A. A histogram index like that shown in 

15 Fig. 7D is calculated from captured image data like that 
shown in Fig. 7C. 

In general, when image data is captured as 
shown in Fig. 8A, two peak portions representing the 
density of a ridge and noise or the like appear in a 
20 histogram as shown in Fig. 8B. As will be described 

below, if a calibration circuit is provided for an image 
capturing section 1 (Fig. 1) to suppress /reduce noise 
and the like, only one peak portion representing the 
density of a ridge can be made to appear in a histogram, 
25 as shown in Figs. 7B and 7D. 

In this embodiment, the frequency which is 
located on the small grayscale value side indicated by 
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the histogram index and exhibits the maximum value on 
the high density side is regarded as a peak value, 
whereas the frequency which corresponds to the minimum 
value immediately near the peak value on the lower 
density side than that of the peak value is regarded as 
a tail value. The histogram index H is defined as H - 
peak value/ tail value. In this embodiment, since 
grayscale value 255 represents white, the tail value 
exists on the right side of the peak value in the 
histogram shown in Fig. 7. Referring to Fig. 8, since 
the peak portion representing the density of the ridge 
exists on the high density side of the image in the 
histogram, the minimum value between the two peak 
portions becomes a tail value, and the maximum value of 
the peak portion on the left of the tail value 
represents the peak value. 

As the value of the histogram index H defined 
in the above manner decreases, the contrast of the image 
decreases, and vice versa. In this embodiment, 
parameters A and B are set on the basis of this 
histogram index H. In image data with little black and 
white difference as shown in Fig. 7A, the histogram 
index H ( = peak value/ tail value) becomes small as shown 
in Fig. 7B. 

In this case, the values of the parameters A 
and B are set to increase the histogram index H so as to 
obtain a result like that shown in Fig. 7D. With this 
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operation, the contrast of the fingerprint image 
increases as shown in Fig. 7C, thereby obtaining a clear 
fingerprint image. As described above, by setting the 
parameters A and B to make the histogram index H fall 
within a preset reference value range, i.e., an 
appropriate range, a fingerprint image suitable for 
fingerprint authentication can be acquired regardless of 
the density of a fingerprint. 

The operation of a fingerprint collation 
apparatus (image capturing apparatus) using a histogram 
index as an evaluation index will be described next with 
reference to the flow chart of Fig. 9. 

A capture control section 3a of a control 
section 3 causes a finger resting prompt section 6 to 
prompt a user intending to perform collation to rest 
his/her finger on a detection surface 12 (Fig. 2) of the 
image capturing section 1 (step SI). More specifically, 
for example, the finger resting prompt section 6 prompts 
the user to rest his/her finger by displaying a prompt 
using a display unit such as an LED or light-emitting 
element, turning on a predetermined indication, or 
outputting a voice message. After a finger resting 
detection section 7 detects that the user rests his/her 
finger on the detection surface 12 upon prompting (step 
S2), the image capturing section 1 captures a 
fingerprint image and outputs image data 2 (step S3). 
These operations are the same as those in the embodiment 
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shown in Fig . 6 . 

In this embodiment, when the image data 2 is 
output, the capture control section 3a calculates the 
histogram index H as an image quality evaluation index 
for the captured image from the image data 2 (step S101) 
Note that the histogram index H may be calculated from a 
predetermined area of the captured image, e.g., an area 
near the center of the detection surface 12, instead of 
all the pixels of the captured image. In this case, the 



01 10 histogram index H can be calculated within a short 

hi 

ri- period of time as compared with the case where all the 

H 

pixels are targeted. 

In steps S102 to S112, the capture control 



fU section 3a compares the histogram index H obtained in 

o 

H 15 the above manner with preset thresholds H t hi and H t h2- 

First of all, in step S102, the capture 
control section 3a checks whether the calculated 
histogram index H is equal to or more than the threshold 
Hthi- If it is determined in step S102 that the 

20 histogram index H is equal to or more than the threshold 
Htm, the flow advances to step S103 to check whether the 
histogram index H is equal to or less than the threshold 
Hth2* If it is determined in step S103 that the 
histogram index H is equal to or less than the threshold 

25 H t h2# the flow advances to step S104, in which the 

capture control section 3a outputs the captured image 
data to a collation means 3b* 
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If it is determined in step S102 that the 
histogram index H is less than the threshold H th i, the 
flow advances to step S105 to check whether the 
parameter value B set in a parameter setting section la 
is the maximum value. 

If it is determined in step S105 that the set 
parameter value B is not the maximum value, the flow 
advances to step S106, in which the capture control 
section 3a increases the parameter value B in the 
parameter setting section la by a predetermined value. 
The flow then returns to step S3. If it is determined 
in step S105 that the parameter value B set in the 
parameter setting section la is the maximum value, the 
flow advances to step S107 to check whether the 
parameter value A set in the parameter setting section 
la is the maximum value. 

If it is determined in step S107 that the set 
parameter value A is not the maximum value, the flow 
advances to step S108, in which the capture control 
section 3a increases the parameter value A in the 
parameter setting section la by a predetermined value. 
The flow then returns to step S3. If it is determined 
in step S107 that the parameter value A is the maximum 
value, the flow advances to step S104, in which the 
capture control section 3a outputs the captured image 
data to the collation means 3b. 

If H < Hthi, since the contrast of the captured 
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image is slightly low, a fingerprint image is captured 
again upon increasing the parameter values A and B in 
the above manner. 

If it is determined in step S103 that the 
5 histogram index H exceeds the threshold H t h2# the flow 
advances to step S109 to check whether the parameter 
value A set in the parameter setting section la is the 
minimum value , e.g., 0 . 

If it is determined that the set parameter 
10 value A is not 0, the flow advances to step S110, in 
which the capture control section 3a decreases the 
m parameter value A in the parameter setting section la by 

y x a predetermined value. The flow then returns to step S3, 

If it is determined in step S109 that the parameter 
15 value A set in the parameter setting section la is 0, 
the flow advances to step Sill to check whether the 
parameter value B set in the parameter setting section 
la is the minimum value. 

If it is determined in step Sill that the set 
20 parameter value B is not the minimum value, the flow 
advances to step S112, in which the capture control 
section 3a decreases the parameter value B in the 
parameter setting section la by a predetermined value. 
The flow then returns to step S3. If it is determined 
25 in step Sill that the parameter value B is the minimum 
value, the flow advance sot step S104, in which the 
capture control section 3a outputs the captured image 



HI 
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data to the collation means 3b. 

If H t h2 < H, since the contrast of the captured 
image is slightly high, a fingerprint image is captured 
again upon decreasing the parameter values A and B in 
the above manner. 

The capture control section 3a repeats the 
above series of operations until the image quality of 
image data satisfies a predetermined condition. When 
the condition is satisfied, the capture control section 
3a outputs the image data as an image suitable for 
authentication to the collation means 3b. As described 
above, according to this embodiment, a fingerprint image 
with excellent contrast can be acquired without being 
influenced by the density of a fingerprint pattern and 
individual differences. 

Note that if the condition cannot be satisfied 
even when the parameters A and B take the maximum or 
minimum values, exceptional processing is performed to 
output the currently captured image. Subsequently, the 
collation means 3b, which has received the image data, 
performs authentication processing by comparing the 
received image data with registered image data G ± to G N 
stored in a storage section 4 . 

In this embodiment, the above operation may be 
performed after the histogram of the captured 
fingerprint image is smoothed. This makes it possible 
to reduce the influence of fluctuations in histogram due 
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to noise, variations, or the like. 

An example of the arrangement of the 
fingerprint collation apparatus (image capturing 
apparatus) according to this embodiment, an example of 
the operation of which has been described with reference 
to the flow chart of Fig. 9, will be described below. 
An arrangement in which a calibration circuit is 
provided for the image capturing section 1 (Fig. 1) to 
suppress /reduce noise and the like will be described 
below. Fig. 10 shows the arrangement of the image 
capturing section 1 having a calibration circuit 105. 
Note that since many sensor cells have the same 
arrangement. Fig. 10 representatively shows one sensor 
cell. 

As shown in Fig. 10, a sensor cell 11 is 
comprised of a detection element 11a, sensor circuit lib, 
and output signal level correction circuit 101. The 
output signal level correction circuit 101 receives an 
output from the sensor circuit lib and supplies the 
output from the sensor circuit lib to one of the inputs 
of a comparing circuit 104. The comparing circuit 104 
compares the output from the sensor circuit lib with the 
calibration reference value (signal) output from a 
calibration reference signal generating circuit 103. 
The calibration circuit 105 adjusts (corrects) the 
output level of the sensor circuit lib by performing 
gain control on the input side of the sensor circuit lib 
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or the sensor circuit lib so as to eliminate the 
difference between the above two values, which is output 
from the comparing circuit 104. 

The calibration reference signal generating 
circuit 103 is preferably configured to generate 
calibration reference signals at the same level to the 
respective sensor cells. 

Any known arrangement that has the function of 
minimizing variations in outputs from the respective 
sensor cells 11 and operates in the above manner can be 
used as the output signal level correction circuit 101. 
With this arrangement, the outputs of the respective 
sensor circuits, i.e., the output levels of the 
respective sensor cells 11, can be adjusted to the same 
level, thus suppressing noise due to sensitivity 
variations and eliminating a peak portion due to noise 
from a histogram index like that shown in Fig. 8B. 

This arrangement will be described in more 
detail below. Fig. 11 shows the arrangement of part of 
the image capturing section 1 formed by the sensor cells 
11 each having the calibration circuit 105. Each sensor 
cell 11 has the same arrangement and is comprised of the 
detection element 11a, sensor circuit lib, and 
calibration circuit (sensitivity adjusting circuit) 105. 
The detection sensitivity of each sensor cell 11 is 
adjusted by using the calibration circuit 105. Each 
sensor cell includes the calibration circuit 105, a 
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signal processing circuit 5, and a control line L c . 

The sensor cell 11 is comprised of the 
detection element 11a, sensor circuit lib, and 
calibration circuit 105. The detection element 11a is 
an element for converting a surface shape into an 
electrical signal. The sensor circuit lib is a circuit 
for measuring an electrical quantity in the detection 
element 11a which changes depending on the surface shape. 

When the output level of each sensor cell 11 
is to be corrected, i.e., calibration is to be performed, 
a reference sample without any uneven pattern is 
detected as a measurement target by the sensor cell 11 
or detection is performed without any object placed on 
the sensor cell, thereby making each sensor cell 11 
detect the same measurement value. The signal output 
from the sensor cell 11 is input to an A/D conversion 
circuit 4 through a data line L D and output as a digital 
output signal 4A. 

The digital output signal 4A output from the 
A/D conversion circuit 4 is input to the signal 
processing circuit 5. The signal processing circuit 5 
compares the digital output signal 4A output form the 
A/D conversion circuit 4 with the digital output signal 
which should be output (to be referred to as an expected 
value hereinafter) to calculate an adjustment parameter 
for adjusting the detection sensitivity of the sensor 
circuit lib. The calibration circuit 105 is then 
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controlled through the control line L c on the basis of 
the calculated adjustment parameter. 

The data line L D and control line L c are 
common to the respective sensor cells 11. The sensor 
cells 11 are sequentially selected, and output signals 
2A from the sensor cells 11 are sequentially input to 
the A/D conversion circuit 4. As a consequence, the 
signal processing circuit 5 controls the calibration 
circuit 105 in the sensor cell 11. 

The sensitivity of each sensor circuit lib is 
adjusted by repeating this operation once or more for 
each sensor cell, thereby making the performance of each 
sensor cell 11 uniform. 

In this case, the signal processing circuit 5 
includes the comparing circuit 104 and calibration 
reference signal generating circuit 103 described with 
reference to Fig. 10 as other signal processing circuits 
110. In the case shown in Fig. 11, the input signal is 
a digital signal. When a digital signal is input to the 
comparing circuit 104 without any conversion, a known 
digital comparing circuit can be used as the comparing 
circuit 104. If the comparing circuit 104 is a general 
analog comparing circuit, an input signal is 
D/A-converted first and then supplied to the comparing 
circuit 104. The same applies to the calibration 
reference signal generating circuit 103. 

As shown in Fig. 12, an image capturing 
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section 1 may be formed by sensor cells 11 each having a 
calibration circuit 105. The image capturing section 1 
shown in Fig. 12 uses a sensor circuit lib' with a 
voltage/time conversion function and a time signal 
comparing circuit 106. The sensor circuit lib' with the 
voltage/time conversion function is a sensor circuit for 
converting an output signal corresponding to an 
electrical quantity from the detection element 11a into 
a signal that changes along the time axis. The time 
signal comparing circuit 106 compares the voltage/time 
conversion signal output from the sensor circuit lib 1 
with the voltage/time conversion function with a 
calibration reference signal, and outputs the signal 
difference as a control signal to the calibration 
circuit 105. When each sensor cell 11 of the image 
capturing section 1 is to be calibrated, a reference 
sample without any uneven pattern is detected as a 
measurement target by the sensor cell 11, thereby making 
each sensor cell 11 detect the same measurement value. 

The sensor circuit lib' with the voltage/time 
conversion function converts a signal having analog 
information as a voltage value into a signal having 
analog information in the time axis direction, and 
outputs the resultant signal as an output signal 2B like 
that shown in Fig. 14 (see Fig. 14: t s is output time 
and changes). The output signal 2B is input to the A/D 
conversion circuit 4 through the data line L D and output 
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as a digital output signal. At the same time, the 
output signal 2B is supplied to the calibration circuit 
105 through the time signal comparing circuit 106 in the 
sensor cell 11. The time signal comparing circuit 106 
corresponds to the comparing circuit 102 in Fig. 10 and 
obtains the time difference between the output signal 2B 
from the sensor circuit lib' with the voltage/time 
conversion function and a reference pulse signal having 
a reference time t R from the calibration reference 
signal generating circuit. 

The time signal comparing circuit 106 compares 
the signal voltage/time-converted by the 
sensor circuit lib' with the voltage/ time conversion 
function with the reference pulse signal, and sends a 
comparison pulse signal representing the time difference 
between them to the calibration circuit 105. With this 
operation, the calibration circuit 105 performs control 
operation to eliminate the time difference from the 
output from the sensor circuit lib 1 with the 
voltage/time conversion function. The data line L D is 
shared by the plurality of sensor cells 11. The sensor 
cells 11 are sequentially selected, and the above 
operation is performed. 

By repeating the above operation once or more 
for each sensor cell 11, the sensitivity of each sensor 
circuit lib' with the voltage/ time conversion function 
to make the performance of each sensor cell 11 uniform. 
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Even if a plurality of sensor cells 11 are 
simultaneously selected, calibration can be concurrently 
performed for each sensor cell. This makes it possible 
to perform calibration at high speed. 

Fig. 13 shows an example of the arrangement of 
each sensor circuit with the voltage/time conversion 
function. The sensor circuit lib 1 with the voltage/ time 
conversion function has, for example, a voltage/ time 
conversion circuit 121. As the voltage/time conversion 
circuit 121, a general -purpose circuit or the like may 
be used. Alternatively, this circuit may be comprised 
of a constant current circuit, capacitive element, and 
threshold circuit 121a (see, for example, Japanese 
Patent Application No. 11-157755). 

The operation principle of the calibration 
circuit using the sensor circuit lib' with the 
voltage/time conversion function will be briefly 
described with reference to Fig. 13. 

The time signal comparing circuit 106 is 
typically formed by an AND circuit. The time signal 
comparing circuit 106 ANDs the output signal 2B from the 
sensor circuit lib 1 with the voltage/time conversion 
function and the reference pulse signal from the 
reference pulse signal generating circuit (not shown) , 
and outputs the resultant data as a comparison signal to 
a counter circuit 154. 

The value of the counter circuit 154 is set in 
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advance to an initial set value that controls all load 
elements Zi to Z N constituting a load circuit 151 in an 
inactive state, and the output signal 2B from the sensor 
circuit lib' with the voltage/ time conversion function 
is also set in advance to an initial set value . If the 
output signal 2B changes earlier than a predetermined 
time in the first sense operation (for example, sense 
operation is performed without placing any object such 
as a finger 21 on the detection surface 12 of the image 
capturing section 1 and an output signal from the sensor 
cell changes within a sense time), the counter circuit 
154 is counted up by one on the basis of the output from 
the time signal comparing circuit 106. As a result, the 
data in the counter circuit 154 changes to activate one 
of the load elements Zi to Z N . In addition, the output 
signal 2B from the sensor circuit lib' with the 
voltage/time conversion function is also restored to the 
initial set value in advance. 

If the output signal also changes earlier than 
a predetermined time in the second sense operation (for 
example, sense operation is performed without resting a 
finger 13 and the output signal from the sensor cell 
changes within the sense time) , the counter circuit 154 
is further counted up by one. In this case, if the 
values of the load elements Zi to Z N are set to be 
sequentially doubled in accordance the bits of the 
counter, twice as many load elements are activated as a 
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consequence. If, for example, Z x = Z, Z 2 = 2Z, Z 3 = 
4Z,..., Z N = 2 (N_1) Z are set, and Z 1 to Z N are 
sequentially controlled from the lower bit of the 
counter circuit 154, the values of the load elements Z x 
to Z N connected to the sensor circuit lib' with the 
voltage/time conversion function sequentially increase 
by Z every time the counter is counted up. 

This operation is repeated until the output 
signal from the sensor circuit lib 1 with the 
voltage/time conversion function does not change in the 
predetermined time (for example, sense operation is 
performed without placing the finger 13, and the output 
signal from the sensor cell does not change in the sense 
time) . When the output signal does not change in the 
predetermined time, the counter circuit 154 is ceased to 
be counted up, and no load element is connected to the 
sensor circuit lib' with the voltage/time conversion 
function any more. 

As described above, since no DC current flows 
in the output level correction system including 
calibration when voltage/ time conversion is performed, 
the power consumption of the overall apparatus can be 
reduced as compared with other embodiments . 

As described above, variations in the 
performance of the sensor cells due to process 
variations and the like can be eliminated by adding the 
calibration circuit 105 to the sensor circuit lib and 



connecting an appropriate number of load elements Zi to 
Z N in the calibration circuit 105 to the sensor circuit 
lib. As a consequence, the performances of all sensor 
cells can be made uniform. 
5 <Third Embodiment > 

An image capturing method according to still 
another embodiment of the present invention will be 
described next. In this embodiment, a ridge count index 
is used as an image quality evaluation index. A ridge 

10 count index will be described first with reference to 
Fig. 15. A ridge of a fingerprint appears as a low- 
grayscale (black) line in a fingerprint image. A ridge 
count index N is obtained in the following manner. 
First, average ridge counts of a fingerprint in the 

15 horizontal and vertical directions are counted within 

the fingerprint determination area (n x m pixels) shown 
in Fig. 15. A larger one of the average ridge counts is 
then selected as the ridge count index N. 

The manner of counting ridges will be 
described below. When, for example, ridges in the 
horizontal direction are to be counted, pixels are 
scanned in the vertical direction, and the number of 
ridges which the scanning beam crosses is counted. 
Letting Ni be the ridge count obtained when pixels 
corresponding to one column are scanned in the vertical 
direction, since the determination areas includes n 
columns, the average ridge count corresponding to the n 
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columns is given by 

jNi/n ...(1) 

Since the length of one column in the vertical 
direction corresponds to m pixels, an average ridge 
count Nv in the horizontal direction per a pixel count P 
is calculated by multiplying mathematical expression (1) 
by P/m so as to normalize the above average ridge count 
into a determined count per P pixels according to 
equation (2) : 

n 

~ Ni 



Nv = — X — . . . ( 2 ) 

n m 

An average ridge count Nh in the vertical 
direction per the pixel count P is obtained in the same 
manner as follows : 

Ni 



P 

Nh = — x — ( 3 ) 

m n 

The ridge count index N is therefore expressed 
as N = MAX (Nv, Nh) , and a larger one of Nv and Nh is 
set as the ridge count index N. 

Fig. 16 explains a ridge determination 
condition. Referring to Fig. 16 , the ordinate 
represents the grayscale value of each pixel; and the 
abscissa, the pixels in the vertical or horizontal 
direction in the determination area. The curve 
representing the grayscale value of each pixel undulates 
in accordance with the ridge/valley pattern of a 



- 33 - 



fingerprint image, and the number of undulations 
indicates the number of ridges . Ridges are counted as 
follows. For example, two thresholds HVTH and LVTH are 
used. When the curve crosses the thresholds HVTH and 
LVTH in the order named, one ridge is counted. In this 
case, the two thresholds are used to prevent pixels 
originating from noise and the like from being counted 
as a ridge. Obviously, HVTH = LVTH may be set to use 
one threshold. 

In addition, ridges can be counted after the 
grayscale value of a fingerprint image is smoothed. 
This makes it possible to reduce the influences of 
fluctuations in the fingerprint image due to noise, 
apparatus variations, and the like. 

If the ridge count index N takes an extremely 
small value, it indicates a state where the fingerprint 
image has collapsed. If the ridge count index N takes a 
large value, it indicates a state where the fingerprint 
image has faded and ridges have broken. If, therefore, 
the ridge count index N takes an extremely small value, 
parameters A and B are adjusted to decrease the image 
density so as to prevent the image from collapsing. If 
the ridge count index N takes an extremely large value, 
the parameters A and B are adjusted to increase the 
image density. With this operation, an appropriate 
fingerprint image free from the influences of the 
density of a fingerprint pattern can be acquired. 
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Note that an ridge count index can also be 
calculated from valleys (the white lines in the 
fingerprint image in Fig. 15) instead of the ridges (the 
black lines in the fingerprint image in Fig. 15). In 
this case as well, an evaluation index equivalent to a 
ridge count index can be obtained. Valleys can be 
counted as follows. Referring to Fig. 16, for example, 
when the curve crosses the two thresholds LVTH and HVTH 
in the order named, one valley can be counted. In this 
case, one threshold can also be set. 

The apparatus according to this embodiment has 
the same arrangement as that of the image capturing 
apparatus (fingerprint collation apparatus) according to 
each of the other embodiments described above. A 
capture control section 3a operates as shown in Fig. 17. 
The operation of the capture control section 3a in the 
fingerprint collation apparatus according to this 
embodiment will be described below. Note that a 
description of constituent elements equivalent to those 
in Fig. 9 will be omitted as needed. 

First of all, the finger resting prompt 
section 6 prompts the user intending to perform 
collation to rest his/her finger on a detection surface 
12 (Fig. 2) of an image capturing section 1 (step SI). 
More specifically, for example, the finger resting 
prompt section 6 prompts the user to rest his/her finger 
by displaying a prompt using a display unit such as an 
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LED or light -emitting element, turning on a 
predetermined indication, or outputting a voice message. 
After a finger resting detection section 7 detects that 
the user rests his/her finger on the detection surface 
5 12 upon prompting (step S2), the image capturing section 
1 captures a fingerprint image and outputs image data 2 
(step S3) . 

H* When the image data 2 is output, the capture 

□ control section 3a calculates the ridge count index N of 

^ 10 the captured image as an image quality evaluation index 

for the image data 2 (step S201). Note that the ridge 
count index N may be calculated from a predetermined 
area of the captured image , e.g., an area near the 
center of the detection surface 12, instead of all the 
15 pixels of the captured image. In this case, the ridge 
count index N can be calculated in a short period of 
time as compared with the case where all the pixels are 
targeted. 

In steps S202 to S212, the capture control 
20 section 3a compares the ridge count index N obtained in 
the above manner with preset thresholds N t hi and N t h2- 

If the capture control section 3a determines 
in step S202 that the calculated ridge count index N is 
equal to or less than N t h2, the flow advances to step 
25 S203 to check whether the ridge count index N is equal 

to or larger than N t hi- If it is determined in step S203 
that the ridge count index N is equal to or more than 
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the threshold N t hi# the flow advances to step S204, in 
which the capture control section 3a outputs the 
captured image data to a collation means 3b. 

If it is determined in step S202 that the 
ridge count index N exceeds the threshold N th 2r the flow 
advances to step S205 to check whether the parameter 
value B set in a parameter setting section la is the 
maximum value. 

If it is determined in step S205 that the set 
parameter value B is not the maximum value, the flow 
advances to step S206, in which the capture control 
section 3a increases the parameter value B in the 
parameter setting section la by a predetermined value. 
The flow then returns to step S3. If it is determined 
in step S205 that the parameter value B set in the 
parameter setting section la is the maximum value, the 
flow advances to step S207 to check whether the 
parameter value A set in the parameter setting section 
la is the maximum value. 

If it is determined in step S207 that the set 
parameter value A is not the maximum value, the flow 
advances to step S208, in which the capture control 
section 3a increases the parameter value A in the 
parameter setting section la by a predetermined value. 
The flow then returns to step S3. If it is determined 
in step S207 that the parameter value A is the maximum 
value, the flow advances to step S204, in which the 
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capture control section 3a outputs the captured image 
data to the collation means 3b. 

If N > N th2 , since it indicates that the 
captured image is faded and too light -colored, a 
fingerprint image is captured again upon increasing the 
parameter values A and B in the above. 

If it is determined in step S203 that the 
ridge count index N is less than the threshold N t hi, the 
flow advances to step S209 to check whether the 
parameter value A set in the parameter setting section 
la is the minimum value, e.g., 0. 

If it is determined that the set parameter 
value A is not 0, the flow advances to step S210, in 
which the capture control section 3a decreases the 
parameter value A in the parameter setting section la by 
a predetermined value. The flow then returns to step S3. 
If it is determined in step S209 that the parameter 
value A set in the parameter setting section la is 0, 
the flow advances to step S211 to check whether the 
parameter value B set in the parameter setting section 
la is the minimum value. 

If it is determined in step S211 that the set 
parameter value B is not the minimum value, the flow 
advances to step S212, in which the capture control 
section 3a decreases the parameter value B in the 
parameter setting section la by a predetermined value. 
The flow then returns to step S3. If it is determined 
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in step S211 that the parameter value B is the minimum 
value, the flow advances to step S204 # in which the 
capture control section 3a outputs the captured image 
data to the collation means 3b. 

If N < Nthi, since it indicates that the 
captured image has collapsed, a fingerprint image is 
captured again upon decreasing the parameter values A 
and B in the above manner. 

The capture control section 3a repeats the 
above series of operations until the image quality of 
the image data satisfies a predetermined condition. 
When the condition is satisfied, the capture control 
section 3a outputs the image data as an image suitable 
for authentication to the collation means 3b. As 
described above, according to this embodiment, a 
fingerprint image free from collapse or fading can be 
acquired without being influenced by the density of a 
fingerprint pattern, individual differences, and state 
changes . 

Note that if the condition cannot be satisfied 
even when the parameters A and B take the maximum or 
minimum values, exceptional processing is performed to 
output the currently captured image. 

In this embodiment, the location and size of a 
fingerprint determination area can be arbitrarily set, 
as needed. 



<Fourth Embodiment > 

In this embodiment, a combination of a 
histogram index and a ridge count index is used as an 
evaluation index in an image processing apparatus and 
fingerprint collation apparatus. 

For example, parameters A and B may be changed 
to make each of a histogram index and a ridge count 
index fall within a predetermined range. 

In addition, a new index may be obtained from 
a histogram index and ridge count index by a 
predetermined computation, and the parameters A and B 
may be changed on the basis of this index. 

With this arrangement, a fingerprint image 
with high contrast free from collapse or fading can be 
acquired without being influenced by the density of a 
fingerprint pattern, individual differences, and state 
changes . 

In this embodiment, the present invention can 
be applied upon replacement of the ridge count index 
with the ridge count index calculated by using valleys 
as described in the second embodiment. 

In the above embodiments, analog values are 
converted into digital values with 256 grayscale levels. 
However, such values may be converted into values other 
than values with 256 grayscale levels. 

According to the present invention, the 
parameter values A and B are used as parameters to be 
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set in the parameter setting section la and used for 
conversion in the image capturing section 1. However, 
the present invention is not limited to them. For 
example, to control brightness and resolution, the 
minimum and maximum values of a signal conversion range 
may be used as the parameter values A and B. The number 
of parameters to be set is not limited to this, and can 
be arbitrarily changed, as needed. 

The above embodiments have exemplified the 
combination of a grayscale index indicating the density 
of image data and an index indicting the spatial 
frequency component of an image and the combination of a 
histogram index generated from a histogram representing 
the density of an image and a ridge count index 
generated on the basis of the number of ridges in the 
image. However, the present invention is not limited to 
them. Obviously, a new evaluation index may be 
generated by combining the respective evaluation indexes, 
as needed. 

As has been described above, according to the 
present invention, image data is captured such that 
evaluation indexes for an image as, for example, a 
fingerprint collation target, fall within certain ranges. 
This produces an excellent effect. That is, an image in 
a desired state can be obtained. For example, the 
precision of fingerprint collation can be improved. 
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